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Abstract. A Chevalley type integral basis for the ortho-symplectic Lie super- 
, algebra is constructed. The simple modules of the ortho-symplectic supergroup 

■ over an algebraically closed field of prime characteristic not equal to 2 are classi- 

^ , fied, where a key combinatorial ingredient comes from the Mullineux conjecture 

' on modular representations of the symmetric group. A Steinberg tensor product 

XJ^ , theorem for the ortho-symplectic supergroup is also obtained. 

(N 

b~* \ 1. Introduction 

1.1. Lie superalgebras, supergroups, and their representation theory over the field 
of complex numbers C have been studied extensively in literature since the classifi- 
cation of finite-dimensional complex simple Lie superalgebras by Kac [H] . More on 
supergroups and supergeometry over C can be found in the book of Manin [T2] . In 
recent years, the modular representations of algebraic supergroups GL(n\m) and 
Q(n) over an algebraically closed field k of characteristic p ^ 2 have been initiated 

OO ! by Brundan, Kleshchev and Kujawa [21151 HI HP]. 

The modular representation theory of supergroups not only is of intrinsic interest 
in its own right (with the rich classical results in representations of algebraic groups 
\q . [8] in mind), but also has found remarkable applications to classical mathematics: 

the classification of simple modules of the spin symmetric group over k in [2] 
using Q(n), and a new conceptual proof in [I] using GL{n\m) of the celebrated 
Mullineux conjecture [13] which describes the correspondence of simple modules of 
the symmetric group S n over k upon tensoring with the 1-dimensional sign module. 
The classification of the simple Q(n) -modules was also nontrivial [3J, in contrast 
03 \ to the algebraic group setup (cf. Jantzen [8|). 

1.2. The goal of this paper is to initiate the study of modular representations 
of the ortho-symplectic supergroup SpO{2n\£) over an algebraically closed field k 
of characteristic p > 2. We construct an integral basis (called Chevalley basis 
as usual) for Lie superalgebra spo(2n\£) and classify the simple modules of the 
algebraic supergroup SpO{2n\£) for every n and £. 

Recall that the ortho-symplectic Lie superalgebra spo(2n\£), which contains 
sp(2n) © so(£) as its even Lie subalgebra, provides the other infinite-series clas- 
sical superalgebras besides type A in the list of [9] . Let us exclude the classical Lie 
algebras by assuming n > 1 and £ > 1 here. The infinite series spo(2n\£) is further 
divided into four infinite families by root systems: the series -B(0, n) corresponding 
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to £ = 1; the series C(n) corresponding to I = 2; the series B(m, n) for £ = 2m + 1 
and the series D(m,n) for £ = 2m, where m > 1. Already over C, the finite- 
dimensional representation theory of B(m,n) and D(m,n) is very challenging and 
remains to be better understood (see Serganova [IS])- The nontrivial classification 
of finite-dimensional simple spo(2n\£)-modules was obtained in [9]. 

1.3. In Section^ we establish by a simple and uniform approach an equivalence of 
categories of rational G-modules and of locally finite (Dist(G), T)-modules under 
some natural assumptions on an algebraic supergroup G, where T is a maximal 
torus of G and Dist(G) denotes the superalgebra of distributions of G. The verifi- 
cation of the assumptions for the equivalence of categories theorem for SpO(2n\£) 
will follow from results in Section [3j These assumptions can be easily checked for 
supergroups GL(n\m) and Q{n). Such an equivalence of categories were earlier es- 
tablished in [3] for Q(n) and later in [I] for GL(n\m) by obtaining in an elementary 
yet ad hoc case-by-case method an isomorphism between a restricted dual of the 
superalgebra of distributions and the coordinate superalgebra of the supergroup. 

We then introduce in Section [3] a Chevalley basis for the Lie superalgebra 
spo(2n\£) for any n,£. While our constructions of the Chevalley basis are car- 
ried out explicitly case by case, we observe a uniform phenomenon quite similar 
to the characterization of Chevalley basis for simple Lie algebras (cf. Steinberg 
[T71 Theorem 1]). The Chevalley basis further leads to a Kostant (integral) basis 
for the superalgebra of distributions Dist(SpO(2n\£)) . In establishing these inte- 
grality statements, we encounter a new phenomenon where twice of an (odd) root 
could sometimes be an (even) root for spo(2n\£). 

In Section HI we establish an analog of the Steinberg tensor product theorem 
for the supergroup G = SpO{2n\£). Once we have the equivalence of categories 
in place (see Section [2]), our approach is quite parallel to [3J SJ [TO], which in turn 
followed a strategy in the algebraic group setup (cf. Cline-Parshall-Scott [S] and 
[8]). The equivalence of categories in Section [2] allows us to study G-modules using 
the highest weight module theory of Dist(G). However a new major difficulty arises 
(when £ > 3): not every simple highest weight Dist(G)-module L(X) for A G X + (T) 
is finite-dimensional, where X + (T) denotes the set of dominant integral weights 
for the underlying even subgroup of G. 

In Section [SI we determine completely the subset X'(T) of X + (T) which param- 
eterize the simple SpO (2n|£)-modules. Note that the subset X\T) differs from 
X + (T) already in characteristic zero (cf. [9]). Remarkably, a key combinatorial 
ingredient in Mullineux conjecture singles out the subset X'(T), which depends 
on the characteristic p of the ground field in general. We refer to the Introduction 
of [1] for more references and history on the solution of Mullineux conjecture by 
Kleshchev and others (also cf. [6l ITS])- 

The main tool in the proof of our classification is the method of odd reflections 
which has been used over C by Serganova et al (cf. [TT], HU US]) and then also used 
by Brundan-Kujawa [I] for GL(n\m) in positive characteristic. To a large extent, 
our proof was inspired by the Brundan-Kujawa classification of simple polynomial 
GL(n|m)-modules, i.e. the simple subquotients appearing in various tensor powers 
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of the natural GL(n |ra)-module. It is a remarkable and puzzling coincidence that 
the simple SpO(2n\2m + l)-modules and simple polynomial GL(n|m)-modules are 
classified by an identical set of weights. Our classification which is valid over C can 
be shown to be equivalent to the classification in [9] over C using Dynkin labels 
where a totally different argument was sketched. 

Acknowledgments. B.S. is partially supported from CSC, NSF and PCSIRT of 
China. He thanks the Institute of Mathematics and Department of Mathematics 
at University of Virginia for the hospitality and support during his visit in 2004-05. 
W.W. is partially supported by NSF and NSA grants, and he thanks Jon Kujawa 
for a stimulating and helpful discussion. 

Convention. The terminology of ideals, subalgebras, modules etc. of a Lie su- 
peralgebra instead of superideals, subsuperalgebras, supermodules, etc. is adopted 
in this paper. 

2. AN EQUIVALENCE OF MODULE CATEGORIES 

2.1. Algebraic supergroups. We first briefly recall the generalities on algebraic 
supergroups, following [3], Section 2], (which is in turn a generalization of the 
approach by Demazure- Gabriel and Jantzen [8]), also cf. [12] . 

Let k be a fixed algebraically closed field of characteristic p ^ 2. All objects in 
this paper will be defined over k unless otherwise specified. Let A = Aq + A\ be 
a commutative superalgebra (i.e. Z 2 -graded algebra) over k, i.e. ah = (— l)' a " b '6a 
for all homogeneous elements a, b G A of degree \a\, \b\ G Z, 2 . In the sequel, we 
assume that all formulas are defined via the homogeneous elements and extended 
by linearity. An element in Aq (resp. A\) is called even (resp. odd). From the su- 
percommutativity it follows that a 2 = for all a G A\. We will denote by solg the 
category of commutative superalgebras over k and even homomorphisms. A funda- 
mental object in satg is the free commutative superalgebra k[x±, . . . , x n ; £i, . . . , £ m ] 
in even generators Xi and odd generators £j. 

An affine superscheme X will be identified with its associated functor in the 
category of superschemes 

Hom(Spec(— ), X) : 5<xlg — > seta. 

The affine superscheme A" - '" 1 := Spec k[xj, . . . , x n \ £i, . . . , £ m ] as a functor sends a 
commutative superalgebra A to A n ^ m (A) = A^ + A™. For an affine superscheme 
X, its coordinate superalgebra k[X] is the superalgebra Mor(A, A 1 ' 1 ) of all natural 
transformations from the functor X to A 1 ' 1 . One has X = Hom sa [ (A;[A], — ). 

An affine algebraic supergroup G is a functor from the category salQ to the 
category of groups, which associates to a commutative superalgebra A a group 
G(A) functorially, and whose coordinator algebra k[G] is finitely generated. For 
an algebraic supergroup G, k[G] admits a canonical structure of Hopf superalgebra, 
with comultiplication A : k[G] — > k[G] <S> k[G], the antipode S : k[G] — > k[G], and 
the counit e : k[G] — > k. Set 

a := ker(5). 
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A closed subgroup of G is an affine supergroup scheme whose coordinate algebra 
is a quotient of k[G] by a Hopf ideal /. In particular, the underlying purely even 
group of G, denoted by G cv , corresponds to the Hopf ideal fc[G]A;[G]i. That is, 
k[G ev ] k[G]/k[G\k[G\i. 

In the remainder of the paper, an affine algebraic supergroup will simply be 
referred to as a supergroup. 

2.2. Superalgebra of distributions. Let G be a supergroup. The superspace of 
distributions (at the identity e G G) is 

Dist(G) := U n > Dist n (G) 

where Dist„(G) := {X G k[G}* | X(3 n+1 ) = 0} = (k[G]/d n+1 )* ■ 

The space Dist(G) is a cocommutative Hopf superalgebra whose multiplication 
* is dual to the comultiplication A of k[G] just as in the ordinary case (cf. [3] and 
[8]). Furthermore, Dist(G) is a filtered superalgebra given by: 

k C Disti(G) C • • ■ C Dist r (G) c Dist r+ i(G) C ■ • • . 

For /i, • • • , f n G d and n G N, we have 

n n 

A(/i -/n)enN/« + /«® 1 ) + D r ® a n+1 " r . 

i=l r=l 

It follows that for X G Dist fl (G) and Y G Dist t (G) 

[X, Y] := X *Y — (-l)l x H y lr * X G Dist^^G). 

Hence, the tangent space at the identity 

T e (G) := {X G Distx(G) | X(l) = 0} ^ (a/3 2 )* 

carries a Lie superalgebra structure; it is called the Lie superalgebra of G and will 
be denoted by Lie(G). 

2.3. The restricted structure on Lie(G). 

Definition 2.1. A Lie superalgebra = 0o + Si is called a restricted Lie superal- 
gebra (or p-Lie superalgebra), if the following conditions are satisfied: 

(a) 0g is a restricted Lie algebra with p-mapping [p] : 05 — > 0o 0, Chap. 4]. 

(b) 0i is a restricted 0Q-module via the adjoint action, i.e. ad(X^)(X 1 ) = 
ad(X)^X 1 ), forXG0 O ,X 1 G0 i . 

Let G be a supergroup. The canonical map tt : k[G] — * fc[G ev ] = fc[G]/&[Cr]A;[G]i 
sends d to the kernel d ev of e ev : &[G CV ] — > k and n(d l ) C a^ for z > 1. This 
induces an injective algebra homomorphism tt* : Dist(G GV ) — > Dist(G). it also 
induces an isomorphism of vector spaces from (d/d 2 )d to a c v/ae V 5 an d both spaces 
are isomorphic to the space do/(3l + M^li)- Thus, we have the following. 

Lemma 2.2. The superalgebra homomorphism it* induces an isomorphism of Lie 
algebras from Lie(G cv ) onto Lze(G)g = Lie(G) PI Dist(G)r). 
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Proposition 2.3. Let G be a supergroup. Then, Lie(G) is a restricted Lie superal- 

v 

gebra with the p-mapping: X i— > for X G Lie(G)o, where X^ := X * ■ ■ ■ * X is 
defined in Dist(G). Moreover, the restricted structure on Lie(G cv ) as a subalgebra 
of Lie(G) coincides with the one induced as Lie algebra of the algebraic group G ev . 

Proof. Since G ev is an algebraic group, Lie(G ev ) is a restricted Lie algebra with the 
p-mapping given by the p-th power in Dist(G ev ) (cf. [HE]). The compatibility of 
the restricted structures on Lie(G) and on Lie(G ev ) now follows from Lemma [2.21 
since 7r* : Dist(G cv ) — > Dist(G) is an algebra homomorphism. 
For X G Lie(G)g, X\ G Lie(G)i, and r > 1, we have 

(ad^rpG) = jy-iy-* ( r )x^ * x, * xr. (2.1) 

This implies that ad(X ) p (X x ) = X bl *X 1 -X 1 * X bl = ad(xf ] )(Xi). Thus the 
Lie(G)g-module Lie(G)i via adjoint action is a restricted module. □ 

For i — 0, 1, we let 

Der fe (A;[G],^ := {X G Hom fe (A;[G],^ | X(fg) = X(f)e(g) + (-l)^s(f)X(g)} 

and let Der fc (/c[G], k) = Der fc (/c[G], /c)g © Der fc (/c[G], k)i. The following can be 
established as in the case of algebraic groups (cf. [1]). 

Lemma 2.4. As restricted Lie super algebras, Lie(G) = Derk(k[G],k). 

2.4. G-modules and Dist(G)-modules. For any vector superspace M, we have 
the general linear supergroup GL(M) which sends each commutative superalge- 
bra A to GL(M, A), the group of all even A-linear automorphisms of M <g) A. 
A representation of a supergroup G or a (rational) G-module, means a natural 
transformation p : G — >• GL(M) for some vector superspace M. As for algebraic 
groups, a representation M of G is equivalent to a right fc[G]-comodule structure 
on M given by an even map rjM '■ M —>■ M £g) k[G] (cf. [3 [3]). We denote by 
G-mod the category of rational G-modules with (not necessarily homogeneous) G- 
homomorphisms. Note that a G- module is always locally finite, i.e., it is a sum of 
finite-dimensional G-modules. 

Given a closed subgroup H of G, a _Dzst(G)-module M is called a (Dist(G), H)- 
module if M has also a structure of iJ-module such that the Dist( H) -module 
structures on M induced from the actions of Dist(G) and of H coincide. We 
denote by (Dist(G) , H)-mod the category of locally finite (Dist(G), if)-modules. 

There is a natural functor 

* : G-mod — ► (Dist(G),H) -mot 

as follows: one endows a G-module M with an action of fi G Dist(G) by (^c?m ® 
/-0 ° Vm, and M is acted by if as a subgroup of G. 



6 



BIN SHU AND WEIQIANG WANG 



2.5. An equivalence of categories. Let G be a supergroup. The Frobenius 
morphism F : G — > G is the natural transformation which assigns to each A £ saljj 
the morphism -F(A) : G(A) — * G(A) induced by a \— > dp r for a £ A. The image of 
F lies in G cv and we often denote F : G — > G ev . For r > 1, we define F r : G — > G cv 
by the r-th iteration of F, whose kernel G r is called the r-th Frobenius kernel of 
G. Since G\ is a normal subgroup of G, G cv Gi := {gogi\go £ G cv ,g\ £ Gi} is a 
subgroup of G. 

Lemma 2.5. For every v ^ 1 , G r Pi G ev — (G ev j r . 

Proof. Note that G r H G cv is the kernel of -F r |G ov ; the restriction to G cv of the 
Frobenius morphism F r on G. Now the lemma follows from that F r \G cv coincides 
with the r-th Frobenius morphism of G cv . □ 

A key argument for the following lemma was supplied by Jon Kujawa. 

Lemma 2.6. Assume G is a supergroup with its even subgroup G cv defined over 
F p . Then, G = G CV G\. Furthermore, G r = (G cv ) r Gi for every r > 1. 

Proof. The restriction -F|g* cv : G cv — > G cv coincides with the Frobenius morphism 
of G ev which is surjective as G ev is defined over ¥ p (cf. [8]). Recall that for any 
g £ G, we have F(g) £ G ev - By the surjectivity of the Frobenius morphism F\o ev 
on G ev , there exists an element g £ G cv so that F(g ) = F(g). Thus, F^g^g) = 1, 
i.e. #i := flb^ £ Gi, and g = g Q gi £ G ev Gi. 

Now if g £ G r , then 1 = F r (^) = F r (g ogi ) = F r (g ), that is g £ G r . It follows 
by Lemma |2"31 that g £ (G cv ) r . □ 

Since Gi is a finite (super)group scheme and fc[GJ is a finite-dimensional Hopf 
superalgebra, we have the next lemma following [SI Chap. 1.8]. Recall for a Gi- 
module M, we have the comodule structure map t\m '■ M — > M ® fc[Gi]. De- 
note by Gi-moc) the category of Gi-modules and by Dist(Gi)-moD the category of 
L>ist(Gi)-modules. Note that Dist(Gi) = k[G x \*. 

Lemma 2.7. T/ie functor : Gi-moc) — > Dist(G i)-moD, which endows a Gi- 
module M with an action of ji £ Dist(Gi) by [idu ® /-0 o^a/? is an equivalence of 
categories. 

For the remainder of this subsection, we make the following assumption on G. 

Assumptions. G is an algebraic supergroup whose even subgroup G cv is a con- 
nected reductive group defined over¥ p with a maximal torus T. Furthermore, there 
is an integral basis for Lie(G) and a corresponding basis for Dist(G) which extend 
the Chevalley basis for Lie(G ev ) and the Kostant basis for Dist(G cv ) respectively. 

It is known (cf. [SJ) that under the above assumption on the algebraic group 
G cv the natural functor ^/ cv : G cv -tTioO — > (Dist(G ev ), T)-moD (defined just as the 
functor is an equivalence of categories. Clearly \^ : G-mod — ► (Dist(G),T) -mod 
is compatible with \l/ ev and also with ^ via forgetful functors. 

Theorem 2.8. Retain the above assumptions on G. Then \1/ is an equivalence of 
categories between G-moO and (Dist(G),T) -mod. 



MODULAR REPRESENTATIONS OF SUPERGROUPS 



7 



Proof. We define a functor \I/ from (Dist(G),T)-moD to G-xnod by lifting every lo- 
cally finite (Dist(G), T)-module to a G-module as follows. Let M be a locally finite 
(Dist(G), T)-module. Noting Dist(G ev ) C Dist(G) as subalgebras and regarding 
M as a (Dist(G cv ), T)-module, we can lift M to an G ev -module canonically as in [El 
pp.171]. In the same vein, noting Dist(Gi) C Dist(G) as subalgebras and regard- 
ing M as a -Dzst(Gi)-module, we can lift M to an Gi-module via an inverse functor 
of (cf. Lemma \2.7\i . The M endowed with these two lifted structures coincide 
as (G cv )i-modules since both are lifted canonically from the same Dist((G cv )i)- 
module structure, and thus they coincide as G\ fl G cv -modules by Lemma [231 By 
Lemmas 12.51 and 12.61 we obtain a well-defined G-module structure on M by letting 
any g = g gi G G with g G G cv and g\ G G\ acts by composing the actions of g 
and g\. 

Clearly, \1/ and \1/ are inverses of each other. □ 



Remark 2.9. It is straightforward to check the assumptions in Theorem 12.81 for 
supergroups GL{m\n) and Q(n), cf. [21 H]. Thus, our Theorem 12.81 gives a simpler 
and uniform proof of the equivalence of categories for these two supergroups ob- 
tained earlier in loc. cit. by first establishing an isomorphism between a restricted 
dual of the superalgebra of distributions and the coordinate superalgebra. We 
shall also see in the next section that the supergroups of type SpO satisfy these 
assumptions as well, and it is not clear if the method in loc. cit. is applicable for 
these new supergroups. 



3. The Chevalley basis of Lie superalgebra spo(2n\£) 

3.1. The supergroup SpO(2n\£). The supergroup GL(r|s) is the functor which 
associates to any A G satjj the group GL(r\s; A) of all invertible (r + s) x (r + s) 
matrices of the form 

a b 
c d 



9 



(3.1) 



where a (resp. d) is an r x r (resp. s x s) matrix with entries in Aq, b, 
(resp. s x r) with entries in A\. The supertranspose of g is defined as 



c is r x s 
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St 



a 

-b l 



c 
d f 



where the superscript t denotes the transpose of a matrix in the usual sense. It 
is well known (cf. e.g. [T2]) that g is invertible if and only if both a and d are 
invertible. Let Mat r \ s be the affine superscheme with Mat r \ s (A) consisting of al 
(r + s) x (r + s) matrices of the form (13. ip . Then k[GL(r\s)} is the localization of 
k[Mat r \ s ] at the function det : g — > detadetfe. The Lie superalgebra of GL(r|s), 
denoted by gl(r\s), consists of matrices of the form (13. ip with a, b,c,d G k, and the 



Z2-grading is defined such that 



a 





d 



is even and 





c 



b 




is odd. 



Recall (cf. [121 Chap. 3]) there is a morphism of supergroups called the Berezian 
or superdeterminant, Ber : GL(r\s) — > GL(1|0) defined as follows: for any A G solg, 
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Ber : GL(r\s; A) — > GL(1|0; A) sends an element g in (13. ip to 

Ber(g) = det(a — M _1 c) ■ det d~ . 

It has various favorable properties, e.g., Ber(g st ) = Ber(g). 

Define the (2n + 2m + 1) x (2n + 2m + 1) matrix in the (n|n|m|m|l)-block form 



-J2n|2m+1 : = 






/„ 











I, 























Im 











I'm 




















1 



(3.2) 



where I n is the nxn identity matrix. Let Zin\2m, denote the (2n + 2m) x {2n + 2m) 
matrix obtained from ^2n|2m+i with the last row and column deleted. Denote by 
SpO(2n\£) (with £ = 2m or 2m + 1) the supergroup functor which associates to 
any A G sotg the group which consists of all (2n + £) x {2n + £) matrices of the 
form 



{g G GL(2n\£; A) | g s % n \ e g = Ber(#) = 1}. 



(3.3) 



Note that the defining relations in (13. 3p are actually defined over ¥ p . The under- 
lying even subgroup is 



SpO(2n\ 



SpO{2n\£) n GL(2n\£) ev ^ Sp(2l) x SO(£). 



3.2. Lie superalgebra spo(2n\£). As in the case of Lie algebras, with the help of 
Lemma [231 we can identify the Lie algebra Lie(SpO(2n\£)) with 

spo{2n\£) := {g G Ql(2n\£) \ g s % n \ e + Z2n\t9 = 0}. 

The spo(2n\2m + 1) consists of the (2n + 2m + 1) x {2n + 2m + 1) matrices in the 
following (n|ra|m|m|l)-block form 



d 

f 


e 

-d l 


<A 


x\ 


-z l 


X 




a 


b 


-v l 


u 


Ih 


c 


-a 1 


—u l 


z 


Z\ 


u 


V 






(3.4) 



where b, c are skew-symmetric, and e, / are symmetric matrices. The Lie superal- 
gebra spo(2n\2m + 1) is called type B(m,n) in [9]. We assume here and below to 
index the rows and columns of (13.21) and (13.41) by the finite set J(2n|2m + 1), where 

I(r\s) := {-r, -r + 1, • • • , -1; 1, 2, • • • ,s}. 

Similarly, the Lie superalgebra spo(2n\2m) consists of the (2n + 2m) x (2n + 2m) 
matrices which are obtained from g of the form (13.41) with the last row/column 
deleted and whose rows/columns are indexed by J(2n|2m). 
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3.3. Chevalley basis for spo(2n\2m + 1). The even subalgebra of spo(2n\2m + l) 
is sp(2n) © so(2m + 1). The Cartan subalgebra f) of spo(2n\2m + 1) is taken to 
be the subalgebra of diagonal matrices, and it has a basis given by Ei- n ^- n — 
Ei t i, Ejj — Ej +m j +m (—n <i<0<j<m), and let 5 a , where a G I(n\m), be the 
dual basis. The standard set II of simple roots is: 

{5- n - 5- n+1 , . . . , <S_2 - <Li, 5-i - 5x, 81-82,..., 5 m -i - 5 m , 5 m } for m > 1, 

with 5-i — 5\ being odd. The corresponding Dynkin diagram is (where the node 
£*D denotes an odd simple root twice of which is not root): 

o O (g) o O ) >Q 

5- n - 5\- n 5-2 - 5-i 5-i - 5i 5i - 5 2 5 m -i - 5 m 5 m 

If m = 0, then the standard set II of simple roots is 

II = {5- n - 5- n+ i, ...,5- 2 - 5-i, 5-i}, 

and its Dynkin diagram is (where the node • denotes an odd simple root twice of 
which is a root): 

o o 

5- n - 5i- n 5-2 - 5-i 5-i 

The set of roots are A = A U A 1; a union of sets of even roots A and odd roots 
Ai, and A = A + U -A + . Set A< = A+ U -A+ for % = 0, 1. More explicitly, 

Aj = {5i ± 5j, -n < % < j < or < i < j < m} 

U{25i, -n < i < 0} U {5j, < j < m}, 
A+ = {5i ± Sj, -n < i < < j < m} U {5i, -n < i < 0}. 

Note that A + is compatible with a set of positive roots of sp(2n) © so(2m + 1) 
whose fundamental system is given by: 

il ev := {5i - 5 i+ i, -n <i < -1; 25-i} U {5i - 8 i+1 , 1 < % < m; 5 m }. 

It is understood that for m = the undefined 5q is omitted from II ev . 

Recall (cf. [TTJ ) that sp{2n) © so{2m + 1) admits a Chevalley basis (unique up 
to signs) {H s (s G il ev ), X a (a G A )}, whose structure constants are integers. One 
of the requirements [TTJ Theorem 1] is that 

[X a , X p ] = ±(r + l)X a+f3 , iia,(3,a + {3e A , (3.5) 

where r is determined by the a-string of roots through (5: {(3 + ia \ —r < i < q}. 
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Remark 3.1. Associated to the even short root 5j with < j < m, we fix the sign 
and take the Chevalley root vector X$. = y/2{Ej^ m +\ — ^m.+ij+m.) where v2 G k. 
The other Chevalley (long) root vectors for sp(2n) ffiso(2m + 1) always have entries 
0, ±1 in the standard matrix form (13 .4ft . 

Now we define the odd root vectors (indexed by their corresponding roots): for 
— n <i<0<j<m, 

Xsi+Sj '■= Ej t i + Ei- n j +m , X^Si-Sj '■= Ej +m ^_ n — Eij, (3-6) 

■^8i—8j := Ej+in,i + ^i—n,ji -^~8i+8j := -£j,i-n -S'ij+m; (3-7) 
Xs i := V2(E2 m +l,i + -^i-n^m+l), -^-5; '■= V^2(-E2m+l,i-n — -^i,2m+l)- (3.8) 

Proposition 3.2. The Chevalley basis elements {H s (s G U ev ),X a (a G A )} for 
the even subalgebra sp(2n) © so(2m + 1) together with X a (a G Ai) in ^3. 6W3.8i) 
form a basis for Lie superalgebra spo(2n\2m + 1) with integer structure constants. 

This basis will be called the Chevalley basis for spo{2n\2m +1). 

Proof. Follows by a direct computation. □ 

3.4. Chevalley basis for spo(2n\2m) , m > 2. We continue to regard Lie superal- 
gebra spo(2n\2m) as a subalgebra of Lie superalgebra spo(2n\2m + 1) in the matrix 
form (13.4p . The even subalgebra of spo(2n\2m) is sp(2n) © so(2m). The Cartan 
subalgebra of spo(2n\2m) is the same as the Cartan subalgebra of spo(2n\2m + 1). 
The standard set Il ev of simple roots for sp(2n) © so(2m) is 

n ev := {Si - 5 i+ i, -n<i< -1; 25„i} U {5i - S i+U 1 < i < m; <5 m _i + S m }. 

Lie superalgebra spo(2n|2m) with m > 2 (and n > 1) is called type D(m,n) in 
[9]. Its standard set II of simple roots is: 

{cL. n - 5i_ n , ■ • • , <5_2 - #-i, - #i, #i - S 2 , ■ ■ ■ , 5 m _i - <5 m , 5 m _i + 5 m }, 
with 5_! — 5i being odd. Its Dynkin diagram is 



o 5, 



m—l 



O-n ~~ 0~l-n 5-2 — 0_i d_i — di 5i — 82 0~m.-2 ~ °~m-l 5 m _l — 5 m 

The corresponding set of positive roots A + = Aj" U A] 1 ", where 

A^ = {5i ± fy, -n < i < j < or < % < j < m} U {25, h -n < i < 0}, 

Af = {5j ± <5j-, -n < i < < j < m). 

The set of roots is A = A+ U -A+. Set Ai = A+ U -A+ for i = 0, 1. 

Proposition 3.3. Lei m > 2. The Chevalley basis elements for the even subalgebra 
sp{2n) © so{2m) together with the odd root vectors X a (a G A x ) in i3.b\3.1\) form 
a basis for Lie superalgebra spo(2n\2m) with integer structure constants. 
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The proof of this proposition is again by a direct computation. This basis will 
be called the Chevalley basis for spo(2n\2m) . 

3.5. Chevalley basis for spo(2n\2). Lie superalgebra spo{2n\2) is called type 
C(n) in [9], and it is more convenient to be realized as osp(2\2n) which consists of 
matrices of the (l|l]n|n)-block form 

a x Xi 
-a y y 1 
y\ x\ d e 

_yt _ % t j _ ( jt 

where e, f are symmetric matrices. We index the rows and columns by I(2\2n). 
The even subalgebra is so(2) © sp{2n). The Cartan subalgebra f) has a basis given 
by £-2,-2 - E ¥ - E n+itn+i (l <i <n), and let $ e f)*(z e 7(l|n)) be the 

corresponding dual basis. 

A standard set II of simple roots is {S-i — S±, Si — 82, ■ ■ ■ , S n -i — S ril 25 n } with 
5-i — Si being odd. The Dynkin diagram with respect to IT is 

(g> o o< ; o 

S-i - Si Si - S 2 S n -i - S n 25 n 

The set of positive roots is A + = U Af, where 

A+ = {Si ± 5j, 1 < % < j < n} U {2Si, l<i<n}, 
A+ = {5_i ± 6 it 1 < i < n}. 
We define the odd root vectors: for 1 < j < n, 

^<5_i+<5j := #-2,j+n + Ej-\, X-S-i-Sj '■= Ej +n _2 ~ E-ij, (3-9) 
^S-i-Sj '■= E-2J — Ej +n _i, X^S-x+Sj '■= #-lj+n + Ej-2- (3.10) 

Proposition 3.4. T/ie Chevalley basis elements for sp(2n), the vector E-2,-2 ~ 
E-x-i in so{2), together with the odd root vectors X a (a E AJ in \3.9\3.1(fy form 
a basis for Lie superalgebra spo(2n\2) with integer structure constants. 

The proof of this proposition is again by a direct computation. This basis will 
be called the Chevalley basis for spo{2n\2). 

Remark 3.5. The Chevalley basis for spo(2n\£) introduced in this paper has the 
following remarkable property (which can be verified case by case): 

[X a , X p ] = ±(r + l)X a+p , if a, /3, a + (3 e A, 

where r is determined by the a-string of roots through (3: {(3 + ia \ —r < i < q} C 
A U {0}. Of course, this is part of the definition of the Chevalley basis for the even 
subalgebra of spo(2n\£), and it makes no difference in this case (and most other 
cases) to have A U {0} here instead of the usual A. The additional {0} is needed 
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exactly when i = 2m + 1 and a = (3 = ±<5j for — n < i < 0, where twice a root 
happen to be a root. 

This observation suggests a possible uniform definition of Chevalley basis for all 
simple Lie superalgebras of the classical types (which has been classified [9]). 

3.6. Basis of the superalgebra of distributions. Let G = SpO(2n\£) and 
q = spo(2n\£) with Chevalley basis {X a , H s , \ a G A, s G Il cv }. Denote by q c the 
complex Lie superalgebra spo(2n\£, C). The PBW theorem for Lie superalgebra 
implies that the universal enveloping superalgebra U(g<c) has a basis 

n x i a n h " is n x ? 

aeA sen ov /3eAi 

with n a ,m s G Z + and e@ G {0,1}. Define the Kostant Z-form 11^ to be the 
Z-subalgebra of IX(gc) generated by the following elements 

4 r) := , « e A , r G Z + ; Jfy, /3 G A l5 
( j := ]^[ (i^ s — j)/m s !, sGiT ev ,m s GZ + . 
We define life := Hi ®i k. 

Theorem 3.6. (a) The superalgebra Hi is a free 7*-module with basis 

n ^ n (f*) n *r («d 

aeA sGn cv V s/ /3eAi 

/or n a ,m s G Z + and £g G {0, 1}, where the product is taken in any fixed 
order. 

(b) As Hopf superalgebras, Ufe isomorphic to Dist(G). 

Proof. The isomorphism in (b) is the reduction modulo p of the isomorphism over 
C just as for algebraic groups, cf. [8j II. 1.12]; also see [31 H] for the supergroups of 
type Q and A. 

The proof of (a) basically follows the proof of [TTI Theorem 2] , with the following 
additional computation regarding the odd root vectors. First, we have for f3 G Ai 
that 

where the coefficients on the right-hand side are integers thanks to a Chevalley 
basis property (3{H S ) G Z. 

Given a G A , (3 G Ai, we have (adJ 5 ^) 3 ^ = since /3 + 3a is never a root for 
spo(2?i|£) by inspection. If (a,&X a ) 2 Xp = 0, then 



x P x^ = x^x p + Y, ^ a xt 1] x v 



i/eAi 
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where [Xp, X a ] = ^2 ueA c p, a Xu with all Cp a G Z by the construction of Chevalley 
basis for spo(2n\£). 

By inspection, the inequality (adX a ) 2 Xp ^ occurs exactly when £ = 2m + 1. 
a = Sj and (3 = ±5i — Sj (or the pair of a, (3 with a simultaneous change of signs), 
where — n <i<0<j<m. By Remark 13. II and the explicit formulas for odd root 
vectors, we have 

XpX^ = X^Xp + Xt 1] [Xp, X a ] + Xjr-V . I (sdX a ) 2 Xp 

= x^Xp + xt 1] x ±Si - xt 2) x ±St+Sj . 

We observe that all the coefficients on the right-hand side are integers. □ 

From now on, we will always identify Dist(G) with (and also the correspond- 
ing subalgebras between them). 

3.7. Various subalgebras. Let T be the maximal torus of G = SpO(2n\£) which 
consists of the diagonal matrices and B be the Borel subgroup corresponding to 
A + . Then Dist(T) has a basis given by (^ s ) for m s e Z + ,s e Il cv , and Dist(B) 
has a basis given by 

n n Q n r t ^ 

for n a , m s G Z + and ep G {0, 1}. 

Clearly, the Frobenius morphism F r preserves the various subgroups T, B cv , B 
of G, for r > 1. We denote by U r the fc-subalgebra of spanned by the elements 
(13.111) with < n Q < p r , < m s < p r and G {0, 1}. As in the purely even 
case (cf. [8]), Dist(G>) = VL r , and we will not distinguish these two super algebras. 
In particular, Dist(Gi) is the restricted enveloping superalgebra of g. Similarly, a 
basis for Dist(B r ) of the r-th Frobenius kernel B r is given by the elements (13.121) 
for < n a < p r , < m s < p r and ep G {0, 1}. 

4. A TENSOR PRODUCT THEOREM FOR SpO{2n\t) 

Let G = SpO(2n\£). The equivalence of categories established in Theorem 12.81 
allows us to study G-modules via a highest weight theory of -Dist (L?)-modules. The 
proofs in this section are similar to [HJHKTU] f° r Q( n ) an d GL(m\n), which in turn 
were super modification from standard developments in the algebraic group setup 
(cf. [5][8]). 

4.1. Highest weight modules. We continue to denote G = SpO(2n\£) with 
maximal torus T and Borel subgroup B as before. The character group is 

X(T) = {Y> i( zi(n\ m )\i5i | all \i G Z} . 
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A standard symmetric bilinear form on X(T) is defined by 

r o, iff^j 

(Mi) = < 1, if z = j < 
[ -1, if z = j > 0. 

Denote F(T) = Hom(G m , T). There is a natural pairing ( , ) : X(T) x F(T) -> Z. 
Given an even root a G A , its coroot a v G ^(T) is defined as in [8]. The Weyl 
group W is generated by the reflections s a for a G A , where s a X = A — (A, a v )a 
for A G X(T). The set 

X+(T) := {A = £ ie/( „ H AA G X(T) | (A,a v > > for all a G A+} 

can be easily identified with 

{A G X(T) | A_ n > • • • > A_i > 0, Ai > • • • > X m > 0}, if t = 2m + 1, 

and identified with 

{A G X(T) | X-n > ■ ■ • > A_i > 0, Ai > • • • > A m _i > |A m | > 0}, if £ = 2m. 

For an A G X(T) and a Dist(G) -module M, the A-weight subspace of M is 

M x = (m G M | f ^ Jm = f^'^Mm, Vs G n cv ,m s G Z + 1 . 
L \m s J \ m s J J 

For A G A(T), we denote the Verma module 

M(A) = Dist(G) ® Dist{ B) kx 

where k\ is the one- dimensional Dist(B)-modvle of weight A (in degree 0). It is 
standard to see that the -Dist(G)-module M(A) has a unique simple quotient L(X) 
and that the -Dzst(G)-modules L(X), X G X(T), are pairwise non-isomorphic. By 
definition, L(X) is X(T)-graded and thus a T-module. 

Lemma 4.1. Every simple module M in the category (Dist(G), T)-moc) is isomor- 
phic to a finite- dimensional highest weight module L(X) for some X G X + (T). 

Proof. Since M is simple and locally finite, it is finite-dimensional. By weight 
consideration, there exists a highest weight vector v\ of weight A G X(T) such 

that Xa\>\ = for all a G A + ,r > 1, (and r = 1 for a odd). It follows that 
M = L(X). Now Dist(G ev ).v\ as a subspace of L(X) is finite dimensional. A 
classical result applied to G cv asserts that A G X + {T). □ 

A major challenge here, which is a super phenomenon and does not occur for 
GL(m\n), is that L(X) for various A G X + (T) may fail to be finite-dimensional 
in general. By the equivalence of categories G-moO = (Dist(G), T)-mo0 in Theo- 
rem [231 we wm no longer distinguish a G-module M from a (Dist(G), T)-module 
M. Define 

X\T) = {A G X + (T) I L(A) is finite-dimensional}. (4.1) 
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By Lemma 14.11 the L(A)'s, where A runs over X^(T), form a complete list of 
pairwise non-isomorphic simple G-modules. Thus, the classification of simple G- 
modules boils down to the nontrivial problem of determining explicitly the set 
X'(T), which will be solved completely in Section [5j 

4.2. The G r -modules. Given A G X(T), define the baby Verma module (which 
is also a G r -module) 

Z r (X) := Dist(G r ) <3 Dis t(B r ) k\. 
One can show as usual that Z r {X) has a unique simple G r -quotient, which will be 
denoted by L r (X). The following is standard. 

Proposition 4.2. Every simple G r -module is isomorphic to L r (X) for some X G 
X(T). Furthermore, L r (X) = L r {jj) if and only if X — \i G p r X(T). 

4.3. A tensor product theorem. 

Proposition 4.3. Let r > 1. 

(1) Every simple G-module regarded as a G r -module is completely reducible. 

(2) For X G X'(T) and ^ V\ G L(X)\, Dist(G r ).v\ is a G r -submodule of L(X) 
and it is isomorphic to L r (X). 

Proof. Let M be a simple G-module. Take any simple G r -submodule Mi in M. 
Then, X^eG cv (fc) * s a completely reducible G r -module; it is also a G cv -module 
and a Gi-module, hence a G-module by Lemma [231 Thus, M = ^ 9gGcv ( fc ) gM±. 

From the 5 r -homomorphism k\ — > L(X) and Frobenius reciprocity, we obtain 
a G r -homomorphism Z r (X) — > L(A) with image Dist(G r ).v\. Now (2) follows 
from that Dist{G r ).v\ is completely reducible by (1) and that Z r (X) has a simple 
G>-quotient L r (A). □ 

Denote X r (T) = {A G X(T) | < (A, a v ) < p r for all a G n cv }. 

Proposition 4.4. For X G X r (T) PI X^T), t/ie restriction to G r of the simple 
G-module L(X) remains to be simple, and is isomorphic to L r (X). 

Proof. By Proposition I4.3[ the G r -module M := Dist(G r ).v\ is isomorphic to 
L r (X). It remains to show that M is a G-module, or to show that M is a DistiG)- 
module. Since DistiG) is generated by Dist(G ev ) and Dist(Gi), it suffices to show 
that M is preserved by the action of Dist(G ev ). Since M is a G r -module and _B CV 
normalizes G r , M is already preserved by the action of -B ev or Dist(B cv ). So it 
remains to show that M is preserved by the action of X^ for every m > 1 and 
negative even roots a. This can be proved by the inductive argument used for the 
supergroup GL(m\ri) in [101 Lemma 6.3] (which goes back to Borel according to 
[31 Lemma 9.8] for Q{n)). We omit the details. □ 

Let us denote by L CV (A) the simple G cv -module of highest weight A G X + {T). 
The pullback L cv (A)' r l := (F r )*L cv (A) as a G-module is clearly simple and isomor- 
phic to L{p r X). We have the following analogue of the Steinberg tensor product 
theorem |16j, which will become more precise with the determination of the set 
X\T) in the next section. 
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Theorem 4.5. (1) For r > 1, A G X r (T) n Xt(T) , and p G X+(T), we /jave 

L(A+p» ^L(A)®L cv (/i)M. 

(2) Let A = E^oP iA(i) be such that A(0) e Xi(T)C\X\T) and A« G Xi(T) for 
1 < i < m. Then 

L(X) * L(A (0) ) ® L ev (A (1) ) [1] ® • • • ® L cv (A (m) ) H . 

Proof. Both statements follow easily with the help of the classical Steinberg tensor 
product theorem for G ev , once we establish the special case of (1) with r = 1. This 
case can be proved using Propositions 14.31 and 14.41 in the same way as for algebraic 

groups [g (cf. (muni). □ 

5. Classification of simple S^O-modules 

5.1. The cases of SpO(2n\l) and SpO(2n\2). Among all spo(2n\£) with n > 
and £ > 0, spo(2n\l) and spo(2n\2) distinguish themselves from the others in that 
they are three-component Z-graded Lie superalgebra: q = g_i + 0o + 0+i, where 
0o coincides with the even subalgebra qq, and q±i is generated by root vectors 
associated to positive /negative odd roots. 

Proposition 5.1. Let n > and i = 1 or 2. Then the L(X), where A runs 
over X + (T), form a complete list of pairwise non-isomorphic simple SpO(2n\£)- 
modules. 

Proof. The proof is the same as in the case of characteristic zero (cf. [9|). Let 
G = SpO(2n\t). By Lemma |4.1 [ every simple G-module is of the form L(\) for 
some A G X + (T). Because of the three-component Z-grading on q = spo(2n\£), 
one has a decomposition Dist(G) = Dist(G)-i ■ Dist(G cv ) ■ Dist(G)+i, where 
Dist{G)±\ is generated by the odd positive /negative root vectors and Dist(G cv ) ■ 
Dist(G) + x is a subalgebra. Then for every A G X + (T), the irreducible Dist(G cv )- 
moduleL ev (A) extends trivially to a Dist(G cv )-Dist(G) + i-modu\e. Hence, K(\) : = 
Dist{G) ®Dist(G cv )-Djst(G) + i L CV (X) is finite-dimensional of highest weight A, with 
L(X) as its irreducible quotient. □ 

5.2. Combinatorics related to Mullineux conjecture. Let \x = (fii, /i2, . . .) 
be a partition. We will identify it with its Young diagram and denote by £(n) its 
length. The rim of the Young diagram \i is the set of cells such that the cell 

+ + is not in \x. The p-rim is a subset of the rim defined as follows in terms 
of p-segments. The first p-segment consists of the first p cells in the rim from the 
left. The second p-segment starts with the first cell in the rim strictly to the right 
of the previous segment, and so on. The last p-segment is allowed to consist of 
possibly cells fewer than p. 

A cell of fi is p-removable if it is at the end of a row of \x and it is in the p-rim but 
not at the end of any p-segment. Denote by J{p) the partition obtained from fi by 
deleting all p-removable cells of \i. The number, denoted by j(fi), of all p-removable 
cells in /i is then given by 

J'O) = M - 1^0)1- 
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Let us denote = J(J % ~ l (n)) for i > 1, with = fi. A partition /i = 

(fix, 1^2, ■ ■ .) is p-restricted (or simply restricted) if either p = or p > and 
/Uj — /Ltj + i < p for all i > 1. Note that the notions j and J make sense for arbitrary 
partitions, and for any partitions \i and u, 

j{li+pv)=j{n). (5.1) 

Let CRCP(<i) be the set of restricted partition of d, and let 317 = \_\ d>0 ^P(d). 

For example, let fi = (5, 4, 3, 3, 1, 1) and p — 5. The p-rim of /x consists of two 
p-segments and it is consisted of the cells colored in black (including both • and the 
double-circled cells) as follows, where the p-removable cells are the double-circled 
ones. Hence = 4, and by deleting the double-circled cells from /x we obtain 
that J(fj) = (4,3,3,3). 

o o o • ® 
o o o ® 
o o o 
• • • 

® 
m 

Theorem 5.2. For fi G set Xi = j'(J* _1 (/i)) fori>l. Then, sending fi G 017 
to M(/j) := (Ai, A 2 , • • •) defines a bijection M: CRCP — > "JIV which satisfies M— AT 1 . 

It is well known that the simple feS^-modules are parameterized by \i G 
CRCP(<i), which are the transposes of the p-regular partitions. The Mullineux conjec- 
ture p3] (now a theorem due to [6]) states that ® sgn = -Dm(^), where sgn is the 
one-dimensional sign /cS^-module. The formulation in Theorem 15.21 due to [TB] of 
the Mullineux bijection M : l R7'{d) — > 5VP(d) is equivalent to the earlier formulations 
by Mullineux, Kleshchev and others (cf. [1] for references and history). 

5.3. The classification. Recall T is the maximal torus of SpO(2n\£), with i = 2m 
or 2m + 1. A weight A G X(T) can be expressed as A = YlieiMm) 

Recall that the simple G-modules have been classified for G = SpO(2n\l) and 
SpO(2n\2). (The case of SpO(2n\l) also fits into the general statement below.) 

Theorem 5.3. (1) Let n > 1. A complete list of pairwise non-isomorphic 
simple SpO(2n\2m + l)-modules is {L(X)}, where X runs over the set: 

{^ieI(n\m)XiSi | A_ n > • • > A_i > 0, Ai > ■ ■ ■ > X m > 0, 

all Xi G Z, j(Ai, • • • , A m ) < A_i} . 

(2) Let m > 2 and n > 1. v4 complete list of pairwise non-isomorphic simple 
SpO{2n\2m) -modules is {L(X)}, where X runs over the following set: 

{^ieI(n\m)Xi5i I A_„ > • • ■ > A_i > 0, Ai > ■ ■ ■ > A m _i > |A m | > 0, 

all Xi G Z, j(Ai, . . . , |A m |) < A_i} . 

Remark 5.4. Theorem 15.31 and its proof below using odd reflections remain to be 
valid over an algebraically closed field of characteristic 0, where j'(/i) (resp. M(ii)) 
for a partition /i is simply replaced by £(/i) (resp. the conjugate partition //). In 
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this classification of the finite-dimensional simple spo(2ri|£)-modules using 

the Dynkin labels appeared in [9], whose sketchy proof uses totally different ideas 
and does not apply to the modular case. It can be shown that the statement in 
loc. cit. is equivalent to ours in characteristic zero. 

The idea of using odd reflections for determining dominant weights (in charac- 
teristic zero) goes back at least to [IT] (also see [H] for a general setup). 

Remark 5.5. The simple polynomial GL(n|m)-modules (i.e. the composition fac- 
tors appearing in various tensor powers of the natural GL(n|m)-module) were 
classified by Brundan-Kujawa [3] (this generalizes some earlier partial result of 
Donkin). According to Theorem 15.31 the simple SpO (2n\ 2m + l)-modules happen 
to admit the same parameterizing set as the simple polynomial GL(n|m)-modules. 
This remarkable fact suggests that the inclusion GL(n\m) < SpO (2n\ 2m + 1) could 
be significant for further development. 

We will present a detailed proof below in the case of G = SpO(2n\2m + 1). 
Denoting the explicit set of weights in part (1) of the above theorem by X^(T) and 
recalling (14.1 1) , we shall prove 

X\T) = X f (T). 

5.4. The inclusion X f (T) C X^(T). Let 9 = SpO(2N\2M + 1) with N > n and 
M > m. We denote by Si with i £ I(N\M) the standard weights for 9, and by 
T/v 5 m the maximal torus for 9 to distinguish from T for G = SpO(2n\2m + 1). 
Denote by Stv+m the symmetric group on the set I(N\M) with subgroups Sn and 
Sm whose notations are self-explained. According to [§J, up to the Weyl group 
equivalence, the systems of simple roots U a are determined by the following set of 
minimal length coset representatives in Sn+m/Sn x Sm'- 

D NM := {a e S N+M | a-\-N) <■ ■ ■< a~\-l), a'^l) <■■■< a~\M)}. 

More precisely, if we denote cr(5i) = 5 a ^ and a (Si ± Sj) = S a ^ ± S a ^, etc, then 
TV 7 := {o~(x) | x £ IT}. Denote by A CT+ the set of positive roots relative to U a . 
We shall denote by L a (X) the irreducible highest weight Dzst(9)-module of highest 
weight A relative to IT 7 . In particular, -^ 1 (A) = L(X). 

Lemma 5.6. A weight A of the form A = ^2^1_ N \5i, where (\-n, ■ ■ ■ , A_i) forms 
a partition, always belongs to X'(T^m)- 

Proof. For 1 < r < N, the r-th exterior power A r V of the natural 9-module 
V = k 2N \ 2M+l is of highest weight A r := ^Z-if 1 5 ^ and thus A - G ^(%)- 
Denote the conjugate partition of (A_at, . . . , A_i) by (r l5 . . . ,r s ), with > r x > 
• ■ ■ > r s > 0. Clearly A = A n + • ■ ■ + A rg , and thus L(A n ) ® • ■ • ® L(A r J contains 
L(A) as a quotient 9-mc-dule. □ 

Each n <T gives rise to a Borel subgroup B a of 9- The Verma module M a (\) : = 
Dist(9) ®Dist(B CT ) k\ has a unique irreducible quotient Dist(9)-module L a (X). The 
method of odd reflections as presented in the next lemma is an effective tool of 
relating different conjugacy classes of Borel subgroups. It was exploited earlier by 
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Serganova and many other authors in characteristic zero and then formulated in 
[U Lemma 4.2] for GL(m\n) in characteristic p > 2. The following argument is 
adapted from loc. cit. in terms of roots and root vectors. 

Lemma 5.7. Let A G X(Tn,m), an d let a = ±5i ±5j be an odd root. Suppose that 
cr, a' G Dn m ore such that A°" + = A°" + U {— a}\{a}. Then, 

L a '(X) i/(A,a)=0 modp, 

L a (\-a) if (X,a)^0 mod p. 

Proof. Let v be a cx-highest weight vector in L a (X) of weight A. For any (3 G 
A CT+ n A CT ' + , we have 

X(sX. a v = {Xp,X„ a }v = (5.2) 

since either (3 — a is not a root or it belongs to A CT+ fl A CT ' + . 
Since 2a is not a root and a is odd, X 2 _ a v = 0. 

If X_ a v = 0, then v is a a'-highest weight vector of weight A, and L a (\) = L°"'(A). 

If X_ a v ^ 0, then X_ a v is a cr'-highest weight vector of weight A — a, and 
L ff (A) L CT '(A-a). 

Now, X_ a v ^ if and only if there exists b G Dist(B a ) such that bX_ a v = v. 
By (15. 2p . we only need to consider b to be a nonzero scalar multiple of X a . Finally 
X a X_ a v = (A, a)v. This completes the proof. □ 

Let w G -0^^ be the distinguished permutation on I(N\M) such that the 
sequence {w(i)} ie /(jv|M) is the sequence which starts first from — N to n — N — 1 
increasingly, then from 1 to M, and finally from n — N to —1 increasingly. Recall 
the Mullineux map M from Proposition 15. 2[ 

Proposition 5.8. Let N > n and (/i-jv> Hi-Ni ■ ■ ■ ■> A*-i) be a partition of length 
< N such that the 'tail' fi >n := (fi n _N, /x n _jv +1 , . . . ,/i_i) is restricted. Let M > m 
be such that M > £(M(fi >n )). Set \x = ^2~=_ N HiO~i- Then we have an isomorphism 
of ^-modules L(fi) = L w (/i w ) with 

n-N-l M 
/i w := M + $>^ >n )^ 

i=—N i=l 

where M(jj, >n )i is the i-th part of the partition M(/j, >n ) := (M(j2 >n )i, M(/j >n ) 2 , ■ • ■). 

Proof. We will apply Lemma 15.71 repeatedly with an ordered sequence of odd re- 
flections associated to the following M(N — n) odd roots: 

5-i - 5 t , 5_ 2 - 5 U ■ ■ • , 5 n ^ N - 5i, 5-i - 5 2 , - 5 2 , ■ ■ ■ , 5 n _ N - 5 2 ; • • • ; 

V v ' V v ' 

5-i - 5 M , 5- 2 - 5 M , • • • , 5 n - N - 5 M ■ (5.3) 



In this way, A + is replaced by A w+ . After the first N — n steps of odd reflections, 
the weight /i is replaced by 



-i 



-N i=n—N 
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Here the numbers Xi G {0, 1} with n — N < i < — 1 are defined starting from 
i = — 1 by the following formula: 

= f if m + J2a_= i+ i x a = mod p, 
\ 1 if ft + Eai+i x a ^ mod p. 

By [H Lemma 6.2], one has 

Hi — Xi — J(fi >n )i, for n — N < i < —1, 

and thus 

n-N-l -1 

£ M+ X J{» >n )iti + j(» >n )Si- 

i=-N i=n-N 

Here and below we write for r > 1 that J r (/i >n ) = ( J r (/i >n ) n _Ar, ■ • • , J r (/i >n )_x). 

Repeating the above reasoning for the next N — n odd reflections among (15. 3p . 
we replace /i by the weight 

n-N-l -i 

X M + X ^ 2 (A* >n )^ + i(^ >n )^i+jV(A* >n ))^ 

i=—N i=n-N 

and so on. Recall the definition of the Mullineux map M and note that J M (fi >n ) = 
thanks to M > £(K(ji >n )). Finally, after all the M(N — n) odd reflections, we end 
up with the weight /z w in the proposition. □ 

Now we are ready to prove that X^(T) C X^(T) for SpO(2n\2m + 1). First, take 
v = J2iei(n\m) e Xt(T) with the additional assumption that u + := (u±, . . . , v m ) 
is restricted. Denote by M(V + ) := (01,02, . . .) which is also a restricted partition. 
It follows by the definition of X>(T) that (i/- n , • • • , ^-i, o-i, o>2, • • •) is a partition. 
Choose M = m and N > n + By Lemma 15.61 the weight 

n-N-l -1 
i=—N i= n -N 

lies in X^T^m)- Note that w has been chosen such that the standard set of 
positive roots for SpO(2n\2m + 1) is a subset of positive roots relative to 7r w 
for S = SpO(2N\2M + 1). This inclusion of roots is compatible with the non- 
standard inclusion I(n\m) <^-> I(N\M) given by (0 >)i i— > i + n — iV, (0 <)j t— > j, 
and it gives rises to an embedding of supergroups SpO(2n\2m + 1) < 9- Applying 
Proposition 15.81 and M _1 = M, we have /i w |t = v. We conclude that v G X^(T) by 
restricting the S-module L w (yU, w ) to the subgroup SpO{2n\2m + 1). 

Write an arbitrary A G X*(T) (uniquely) as A = ^+pYm=i f° r some partition 
r = (ri, . . . , r m ) and v G X^(T) with u + being restricted. Since j(V + ) = j(A + ) by 
(15.11) . we have v G X^(T). By the tensor product Theorem 14. 5 1 

m 

L(A)^L(^)®L CV (X^) [1] , 

i=l 

whence A G X\T) and X f (T) C X\T). 
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5.5. The inverse inclusion X^(T) C X^(T). Part of the necessary conditions for 
A G X'(T) is easy to determine. 

Lemma 5.9. Assume A = ^2 ie jt n \ m \ K^i £ X'(T). Then, (A_ n , . . . , A_i) and 
A + := (Ai, . . . , A m ) are partitions. 

Proof. Since A + contains A + (Sp(2n)), the fact that A belongs to X\T) implies 
that (A_ n ,...,Ai) is a partition by the classical result (cf. e.g. [8]). Similarly, 
Since A + contains A + (SO(2m + 1)), A + is also a partition. □ 

To prove X^(T) C X^(T), it remains to show that j(X + ) < A_i for A G X*(T). 
To that end, we first consider the special case of SpO(2\2m + 1) (i.e. n — 1) whose 
maximal torus will be denoted by T l m . Recall the standard set of simple roots for 
SpO{2\2m+l) is II = {6-i — Si, S± — 62, ■ ■ ■ , 6 m -i—5 m , 6 m }, with 5-i — 5i being odd. 
Let z G Si +m be the permutation defined by z(— 1) = 1, z(l) = 2, ■ • • , z(m — 1) = 
m,z(m) = — 1. Then 

n z = {<5i - <5 2 , . . . , <5 m _i - <5 m , <5 m - <Li, 

with <5 m — 5-i and 5_i being odd. 

Via an ordered sequence of odd reflections associated to the m odd roots 

5-i - 5 U 5-i -5 2 ,...,5_i- 5 m , 

the highest weight A relative to the standard Borel is replaced by some A z = 
Siej(iim) ^H&ii w hh all A z G Z, which is a highest weight relative to the Borel B z . 
That is, L(A) = L Z (A Z ). Note that A z+ := (A z , . . . , A^) is a partition by considering 
the restriction of L Z (A Z ) to the subgroup SO (2m + 1) since the standard Borel of 
SO(2m + 1) is a subgroup of the Borel B z of SpO(2\2m + 1). 

Lemma 5.10. Assume A = J2iei(i\ m ) e ^(^i,m)- Retain the notations as 
above. Then, we have 

A z x G Z+ 
J(A Z +) = A + 
j(A z+ ) = A_ 1 -A z 1 

j(A + ) < A_i. (5.4) 

Proof. We have A z 1 G Z + since 25-\ is a positive root in Il z . 

Via an ordered sequence of odd reflections associated to the m odd roots 

5 rn - 5-1, ...,5x- 5-i, 

the weight A z relative to the Borel B z is replaced by the weight A. The identity 
J(A Z+ ) = A + now follows by an argument which is completely parallel to the one 
for Proposition 15.81 (also compare the proof of [H Lemma 6.2]). 
Next, we have 

J(A Z +) = |A Z+ |-|J(A Z+ )| 

= |A Z+ | - |A + | = A_i - A z ! 
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where the last equation is a byproduct of the above procedure of odd reflections. 
Finally, (15.41) follows from a direct computation: 

j(A+) = jV(A z+ )) 

< j(A z+ ) = A_x - A»! < A_l 

□ 

The supergroup SpO{2\2m + 1) can be regarded naturally as a subgroup of 
SpO(2n\2m + 1) in a way compatible with the natural inclusion I(l\m) C J(n|m), 
and thus the corresponding fundamental systems of the two supergroups are com- 
patible. Hence, A = Y,iei(n\m) G X^(T) implies that Ei G /(i|m) A A G ^(^l.m), 
by restricting the SpO(27?,|2m. + l)-module L(A) to the subgroup S'pO(2|2m + 1). 
It follows by Q that j(A + ) < A_i for A e X^T). This together with Lemma El 
imply that X'(T) C X' (T) in the general case of SpO(2n\2m + 1). The proof of 
Theorem 15.31 for SpO(2n\2m + 1) is now completed. 

Remark 5.11. Theorem 15.31 for the classification of simple SpO (2n\2m)-modules 
can be established using the same ideas in two steps as above and so we will skip 
the details. The only difference here is that the odd reflections associated to the 
odd roots 5i + 5j will also be used. The appearance of the absolute value |A n+m | 
comes from the weight condition of SO(2m) (compare Lemma [5.91 and its proof). 
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